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METHOD AND SYSTEM FOR 
DIAGNOSING, COLLECTING 
INFORMATION AND SERVICING A 
REMOTE SYSTEM 

Cross Reference to Related Applications 

Continuity Statement The present application, attorney docket number 5244-0130-2, is 
related to the following U.S. applications and patents: 09/575,702 filed July 12, 2000; 
09/453,934 filed May 17, 2000; 09/453,935 filed May 17, 2000; 09/453,936 filed May 17, 
2000; 09/453,937 filed May 17, 2000; 09/542,284 filed April 4, 2000; 09/520,368 filed 
March 7, 2000; 09/440,692 filed November 16, 1999; 09/440,647 filed November 16, 
1999; 09/440,646 filed November 16, 1999; 09/440,693 filed November 16, 1999; 
09/440,645 filed November 16, 1999; 09/408,443 filed September 29, 1999; 09/407,769 
filed September 29, 1999; 09/393,677 filed September 10, 1999; 09/31 1,148 filed May 13, 

!, i 1999; 09/192,583 filed November 17, 1998; 09/190,460 filed November 13, 1998; 

!'= 08/883,492 filed June 26, 1997; 09/108,705 filed July 1, 1998; 09/107,989 filed July 1, 

- : 1998; 08/997,482 filed December 23, 1997; 08/997,705 filed December 23, 1997; 

08/738,659 filed October 30, 1996; 08/738,461 filed October 30, 1996; 09/457,669 filed 

11 December 9, 1999; 08/916,009 filed August 21, 1997; 07/902,462 filed June 19, 1992; 

"J 07/549,278 filed July 6, 1990; 5,908,493; 5,887,216; 5,818,603; 5,819,1 10; 5,774,678; 

5,649,120; 5,568,618; 5,544,289; 5,57,554; and 5,412,779. The contents of each of those 

□ applications and patents is incorporated herein by reference. 

□ Background of Invention 

*■ j 

I'll [0001] The present invention generally relates to a method and system that can monitor 

ifi 

|;3 state and event information of a remote device and communicate the information over 

o 

the Internet to a central information system. The central information system can analyze 
the state and event information to determine the condition of the remote device and/or 
whether the remote device needs preventative or reparative maintenance. 



[0002] Maintenance and repairs for devices are expensive. Often the cost of preventative 
maintenance is less than that required for repairs or replacement of parts of a device. By 
identifying potential problems, repairs and their associated costs can be avoided. Some 
devices have sensors to determine their own states, some of which are locally 
communicated to the device user through a display (e.g., a low toner display of a 
copier). Such displays will indicate to the owner when action should be taken locally to 



Page 2 of 46 



% f 



correct any potential problems with the device. 

[0003] Motor vehicle owners spend time and money to keep their motor vehicle in good 
condition. Worn out parts or low fluid levels if not repaired or replace quickly can 
damage other parts of the motor vehicle. Accidents or expensive repairs may result if 
repairs or replacement are not performed immediately (e.g., rotors need replacement if 
brake shoes are not replaced for a car). Motor vehicles have sensors to determine the 
state of the motor vehicle, some of which locally communicate their state to the owner 
through the gauges (e.g., temperature of radiator, voltage of the battery, oil pressure, and 
gas level in a car). Those gauges will locally indicate to the owner when action should 
be taken to correct any potential problems with the motor vehicle. 

[0004] Internet communication is becoming increasingly popular. Examples of Internet 
communication include RFC 2298 - An Extensible Message Format for Message 
Disposition Notifications and " Web on Wheels: Toward Internet Enabled Cars" by A. 
Jameel, M. Stuempfle, D. Jiang, and A. Fuchs, 1998 IEEE Vol.3 1, No. 1 : January 1998, 
pp. 69-76. The contents of both of those articles are incorporated herein by reference. 

Summary of Invention 

[0005] Not all conditions of a device (e.g., digital imaging device) can be displayed or 

corrected locally by the owner of the device. By monitoring the state of various parts of 
the device and communicating this information to a remotely located central information 
system, the condition of the device may be reported to the device dealer or service 
center who can take action to correct the problems that may exist. Thus, it is an object of 
the present invention to use a Wide Area Network (e.g., the Internet) to remotely 
monitor the states of remotely located devices. Examples of states are the measures of 
the amount of resources available or the environmental conditions. It may be helpful to 
know the states of a device so as to recognize possible conditions that can impair the 
performance of the device. 
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[0006] It is an independent object of the invention to monitor the events and states of a 
unit such as a car, motorcycle, recreation vehicle (RV), motorized boat, train, or 
airplane. The events are the interaction between the user and the unit. As an example, it 
may be desirable to monitor the user's use of the various electronic components of the 
unit (e.g., the power windows, cruise control, air conditioning, or power seats). Event 
information is helpful to the motor vehicle manufacturer to determine which features of 
a motor vehicle are desirable among its users. 

[0007] The states are measures of the conditions (e.g., the fuel level, the oil pressure, or 
the temperature level of the radiator) of the unit. State information is helpful to the unit 
manufacturer to perform diagnostics to determine if service or maintenance is needed 
for the unit (e.g., motor vehicle). Further it may be desirable to monitor the state 
changes within the unit. Some state changes in a motor vehicle or other unit may be 
signs of potential problems. For example, the rapid rise in temperature of the radiator of 
a car possibly indicates that the radiator is overheating. By monitoring the state of 
various parts of the motor vehicle and communicating this information to a central 
information system, the condition of the motor vehicle may be reported to the motor 
vehicle dealer or service center who can take action to correct the problems that may 
exist. 

[0008] A further object of the present invention is to provide a system for communicating 
data obtained by monitoring the device to a central information system allowing various 
data formats that ease the analysis of received data at the receiving side. 

[0009] A further object of the present invention is to communicate the monitored event 
and state information periodically or when potential breakdown conditions occur in the 
device. 
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[0010] A further object of the present invention is to efficiently communicate the 
monitored information to a transmission unit. 

[001 1 ] A further object of the present invention is for the central information system to 

maintain a history of the data and to analyze the data and, if necessary, communicate the 
information to a device dealer or service center that can contact the device having the 
potential problem. The device dealer or service center can provide the services to repair 
the devices. 

[0012] The present invention achieves these and other objects by monitoring the states and 
events of the device. The data obtained by monitoring the states and events of a device, 
as a further feature in the present invention, is collected, logged, and communicated to a 
central information system (e.g., using Internet e-mail or the File Transfer Protocol 
(FTP)). The use of e-mail communication reduces the costs associated with 
communicating such data. The data can be communicated to the central information 
system at several instances. Such instances include each time a user turns off the device, 
or after a predetermined number of times that a user has utilized and turned off the 
device, or after a predetermined time period, or when potential breakdown conditions 
exist in the device. If the configuration allows and if necessary, the direct connection 
such as FTP between the monitored application and the monitoring system can be 
established in addition to the e-mail communication. 

Brief Description of Drawings 

[0013] A more complete appreciation of the present invention and many of the attendant 
advantages thereof will be readily obtained as the same becomes better understood by 
reference to the following detailed description when considered in connection with the 
accompanying drawings, wherein: 
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[0014] Figure 1 illustrates the use of a central service center to monitor the conditions of 
remotely located devices such that a service center/depot can perform preventative 
maintenance on the devices; 

[0015] Figures 2A-2C illustrate first through third exemplary embodiments of a device 

connected to a network of computers and databases through a Wide Area Network (e.g., 
the Internet); 

[0016] Figures 3 A and 3B illustrate functional and hardware block diagrams, respectively, 
according to the present invention; 

]% [0017] Figure 4 illustrates components of the device according to one embodiment of the 

jj .=5 

l [I present invention; 

"'"4 [0018] Figure 5 shows the general architecture of the device according to the present 

M 

O invention; 

□ 

jj [0019] Figure 6A shows the general architecture of the Monitoring System; 

[0020] Figure 6B is an exemplary EventData class interface for use in the architecture of 
1=3 Figure 6 A; 

[0021] Figure 6C is an exemplary FormattedEventData class interface for use in the 
architecture of Figure 6A; 

[0022] Figure 7 shows the calling sequence of the interface functions within the device of 
the present invention; 

[0023] Figure 8 shows the processing when the Monitoring System sends the monitored 
event and state information with the specified formats using the specified protocols; 
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[0024] Figure 9 shows an alternative calling sequence of the interface functions from the 
device according to the present invention; and 

[0025] Figure 10 illustrates the elements of an exemplary computer for use in an 
exemplary embodiment of the present invention. 

Detailed Description 

[0026] Referring now to the drawings, wherein like reference numerals designate identical 
or corresponding parts throughout the several views. Figure 1 illustrates Device 20A and 
Device 20B whose states and events are being monitored. The devices can refer to 
business office machines such as copiers, facsimile machines, facsimile servers, 
scanners, a thin server or printers. The devices can also refer to appliances such as 
microwave ovens, VCRs, digital cameras, cellular phones, or palm top computers. 
Further, the devices can refer to metering systems (e.g., gas, water, or electricity 
metering systems), vending machines, or any other mechanical devices including mobile 
units such as automobiles, motor cycles, boats, trains and airplanes. In addition to 
devices referring to special purpose machines, the devices can refer to general-purpose 
computers. 

[0027] Referring to Figure 1, the events of Device 20A are monitored as the events occur 
(e.g., when the user interacts with the operation panel of a copier). The states (e.g., the 
toner level of the copier) of Device 20A are also monitored. The states of Device 20A 
can be monitored periodically (e.g., every 5 minutes or 10 minutes) or aperiodically. 
Also, the states of Device 20 A can be monitored as the condition of Device 20A 
changes (e.g., when the toner level lowers). In an embodiment using a DLL, the 
monitoring DLL will collect and record the event and state information of Device 20A. 
Then this information is communicated to a Central Service Center 26 via email or ftp 
through a wide area network (WAN) (e.g., the Internet or its successor), generally 
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designated by 10. The WAN 10 can either be a private WAN or a public WAN. The 
Central Service Center 26 can be geographically located where the communication costs 
would be low. As is described in more detail below, the events and states of Device 20B 
are monitored (collected and recorded) and communicated in a similar manner as Device 
20A. 

[0028] Further in Figure 1 5 the Central Service Center 26 has connected thereto Data 28 
that may be stored in a database format. The Data 28 includes a history of the state and 
event information of Device 20A that is being monitored. The Central Service Center 26 
can analyze how Device 20A is being used and its condition. From the analysis of the 
Data 28, the Central Service Center 26 can identify some conditions in Device 20A that 
may require some service to be performed on it. Thus, the Central Service Center 26 
may communicate a service request to a Service Depot/Dealer 30 A or 3 0B through the 
Internet 10. The Service Depot/Dealer 30A or 30B (30A/B) can properly respond to the 
service request for Device 20 A. The Service Depot/Dealer 30A/B can obtain the service 
history of Device 20A from the Central Service Center 26 through the Internet 10. The 
Service Depot/Dealer 30A/B may contain an interface unit that allows it to interface 
with the information provided by the Central Service Center 26. For example, the 
interface unit allows the information from the Central Service Center 26 that is in one 
language to be converted into to another language to be read at the Service Depot/Dealer 
30A/B. After the Service Depot/Dealer 30A/B analyzes the service history and service 
request, it communicates the service request to Device 20A through the Internet 10. The 
user of Device 20A can then respond appropriately to the service request. Alternatively, 
the Service Depot/Dealer 30A/B may contact the owner of Device 20A via e-mail or 
through the phone. If necessary, the Service Depot/Dealer 30A/B may obtain 
information from Device 20A through the Internet 10. 
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[0029] In a similar manner in Figure 1, the event and state information of Device 20B is 
communicated to the Central Service Center 26 through the Internet 10. The Data 28 
includes a history of the state and event information of Device 20B. As it did for Device 
20A, the Central Service Center 26 can identify some conditions in Device 20B that 
may require some service to be performed on it. The Central Service Center 26 can 
communicate a service request to the Service Depot/Dealer 30A/B through the Internet 
10. The Service Depot/Dealer 30A/B can obtain the service history of Device 20B from 
the Central Service Center 26 through the Internet 10. After the Service Depot/Dealer 
30A/B analyzes the service history and service request, it communicates the service 
request to Device 20B through the Internet 10. The user of Device 20B can then respond 
appropriately to the service request. 

[0030] Figure 2A illustrates a device 20C (generally "20") according to the present 
invention that is connected to a Wide Area Network (WAN) 10 via a wireless 
connection (e.g., using a radio frequency (RF) or infra-red (IR) transmitter or 
transceiver). The device 20 obtains events and state information from internal sensors 
that describe the interactions with the user and how the device is changing or behaving. 
That state and event information is communicated to a recipient. Wireless transceivers 
are commercially available from Ricochet Wireless, Sprint PCS Wireless, and RCN's 
Blackberry Wireless Email. 

[003 1] In a first embodiment of a device connected to a network of computers and 

databases through the WAN 10, the WAN 10 includes a plurality of interconnected 
computers and routers designated by 12A-12I. The manner of communicating over a 
WAN is known through RFC documents available at HTTP://www.ietf.org/rfc.html. 
Transmission Control Protocol/Internet Protocol (TCP/IP) related communication is 
described in several references, including (1) TCP/IP Illustrated, Vol. 1, The Protocols, 
by Stevens, from Addison- Wesley Publishing Company, 1994, ISBN: 0201633469, (2) 
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Internetworking with TCP/IP by Comer and Stevens, 4th edition, Vol. 1 (April 15, 
2000), Prentice Hall; ISBN: 0130183806 , (3) Internetworking with TCP/IP, Vol. II, 
ANSI C Version: Design, Implementation, and Internals, by Comer and Stevens, 3 
edition (June 10, 1998) Prentice Hall; ISBN: 0139738436, and (4) Internetworking with 
TCP/IP, Vol. Ill, Client-Server Programming and Applications- Windows Sockets 
Version, by Comer and Stevens, 1 edition (April 28, 1997) Prentice Hall; ISBN: 
0138487146. The contents of all four books are incorporated herein by reference in their 
entirety. 

[0032] In Figure 2 A, a firewall 40B is connected between the WAN 10 and a network 52. 
Also, a firewall 40A is connected between the WAN 10 and a workstation 42. Firewalls 
(generally "40") are devices that allow only authorized computers on one side of the 
firewall to access a network or other computers on the other side of the firewall. 
Firewalls such as firewall 40A and 40B are known and commercially available devices 
and/or software (e.g., SunScreen from Sun Microsystems Inc.). 

[0033] The network 52 is a conventional network and includes a plurality of workstations 
56A-56D. Such workstations may either be in a single department or multiple 
departments. In addition to the workstations connected via the network 52, there is a 
workstation 42 that is not directly connected to the network 52. Information in a 
database stored in a disk 46 may be shared using proper encryption and protocols over 
the WAN 10 to the workstations connected directly to the network 52. Also, the 
workstation 42 includes a direct connection to a telephone line and/or Integrated 
Services Digital Network (ISDN) and/or cable and/or wireless network 44, and the 
database in disk 46 may be accessed through the telephone line, ISDN, cable or 
wirelessly. The cable used by this invention may be implemented using a cable which 
typically is used to carry television programming, a cable which provides for high speed 
communication of digital data typically used with computers or the like, or any other 
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desired type of cable. The workstations 42 and 56A-56D that are connected to the WAN 
provide a secure connection to the device 20. This allows the device 20 to properly 
communicate state and event information to any of the workstations 42 and 56A-56D. 
Devices 58A-58D are data storage devices. 

[0034] The network 52 can be part of the Central Service Center 26 of Figure 1 that 
maintains a history of state and event information of Devices 20A and 20B. 
Alternatively, the workstation 42 and disk 46 can be part of the Central Service Center 
26 of Figure 1 . It is also possible that the network 52 or the workstation 42 and disk 46 
can be a Service Depot/Dealer 30A/B of Figure 1. 

[0035] Event and state information of Device 20C may be stored in one or more of the 
databases stored in the disks 46, 54, and 58A-58D. Known databases include (1) SQL 
databases by Microsoft, Oracle and Sybase, (2) other relational databases, and (3) non- 
relational databases (including object oriented databases). Each of the different 
departments (e.g. marketing, manufacturing, design engineering and customer service 
departments) within a single company may have their own database or may share one or 
more databases. As an example, disk 58 A contains the marketing database, disk 58B 
contains the manufacturing database, disk 58C contains the design engineering database, 
and disk 58D contains the customer service database. Alternatively, the disks 54 and 46 
store one or more of the databases. Each of the disks used to store databases is a non- 
volatile memory such as a hard disk or optical disk. Alternatively, the databases may be 
stored in any storage device including solid state and/or semiconductor memory devices. 

[0036] A feature of the present invention is the use of a "store-and-forward" mode of 
communication (e.g., Internet e-mail) or transmission between the device 20 and a 
workstation for monitoring the state and event information. The "store-and-forward" 
process avoids the device 20 from having to wait until a direct connection is established 
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with the recipient. Because of network delays, the communication could take a 
substantial amount of time during which the application would be unresponsive. Such 
unresponsiveness can be unacceptable to the recipient. By using e-mail as the store-and- 
forward process, retransmission attempts after failures occur automatically for a fixed 
period of time. Alternatively, the message that is transmitted may be implemented using 
a mode of communication that makes direct, end-to-end connections. 

[0037] Figures 2B and 2C illustrate alternative systems according to the present invention 
in which different devices and subsystems are connected to the WAN 1 0. However, 
there is no requirement to have each of these devices or subsystems as part of the 
invention. Each component or subsystem illustrated in Figures 2A-2C is individually a 
part of the invention. Further, the elements illustrated in Figure 2A may be connected to 
the WAN 10 that are illustrated in Figures 2B and 2C. In Figure 2B, there is a device 
20D that is connected to the WAN 10 via a wireless connection. Further in Figure 2B, 
there is illustrated a firewall 40C connected to an Intranet 1 12. The service machine 1 14 
connected to the Intranet 1 12 includes therein or has connected thereto data 116 which 
may be stored in a database format. The data 116 may include a history of the state and 
event information of the device 20D that is being monitored. The service machine 1 14 
may be implemented as any type of device and is preferably implemented using a 
computerized device such as a general-purpose computer. 

[0038] An alternate type of sub-system includes the use of an Internet Service Provider 

(ISP) 1 1 8 that may be any type of ISP, including known commercial companies such as 
for example America Online, Mindspring, and Niftyserve. In this sub-system, a 
computer 120A is connected to the ISP 1 1 8 through a modem (e.g., an analog telephone 
line modem, a cable modem, an ISDN-based modem, an Asymmetric Digital Subscriber 
Line (ASDL)-based modem, a frame relay adapter, a.wireless (e.g., radio frequency) 
modem, an optical modem, or a device that uses infrared light waves). The computer 
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120A may receive state and event information communicated to it by a device 20D. 

Also illustrated in Figure 2B is a firewall 40E connected to a network 126. The 
network 126 mayibe implemented as any type of computer network (e.g., an Ethernet or 
Token-Ring network). Networking software that may be used to control the network 
includes any desired networking software including software commercially available 
from Novell or Microsoft. The network 126 may be implemented as an Intranet, if 
desired. Computers K20B and 120C connected to the network 126 may receive event, 
state and even positiom information from the device 20D. The wireless communication 
described herein may be established using spread spectrum techniques including 
techniques which use a spreading code and frequency hopping techniques such as the 
frequency hopping technique disclosed in the Bluetooth Specification (available at the 
world wide web site www.bluetooth.com), which is incorporated herein by reference. 

Another sub-system illustrated in Figure 2B includes a firewall 40D, an Intranet 
132, and a computer 120D. The computer 120D may receive state and event information 
from the device 20D. 

[0041] The third exemplary embodiment illustrated in Figure 2C contains many of the 
same elements as in Figure 2B. Repeated elements are not further explained herein, 
instead only the additions are discussed. Computer 120 A connected to the WAN 10 
through the firewall 40F. The computer 120A is part of the service depot/dealer that 
receives information about repairs or maintenance needed for Device 20D from the 
Central Service Center. The computer 120 A communicates with the computer 120F of 
the Central Service Center through the WAN 10. The computer 120A obtains service 
history information about Device 20D. The computer 120A analyzes the service request 
and the service history of Device 20D and then communicates the service request to 
Device 20D through the WAN 10. The user of Device 20D then responds appropriately 
to the service request. 



[0039] 




[0040] 
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[0042] Further in Figure 2C, a network 126 is connected to the WAN 10 through the 

firewall 40E, and a computer 120C is connected to the network 126. The firewall 40E, 
network 126, and computer 120C can belong to another service depot/dealer that 
performs repairs and maintenance on other devices that is monitored by the Central 
Service Center. The Central Service Center can communicate service requests to the 
computer 120C for all devices that this service depot/dealer repairs and maintains. The 
computer 120C will communicate with the computer 120F of the Central Service Center 
through the WAN 10 to obtain service history of the devices it is responsible for 
repairing and maintaining. The computer 120C will analyze the service requests and the 
service history of devices and then communicate the service requests to the devices 
through the WAN 10. The users of the devices can then respond appropriately to the 
service requests. 

[0043] Further in Figure 2C ? an Intranet 132 is connected to the WAN 10 through the 

firewall 40D. In a similar manner as the computer 120C, the computer 120D connected 
to the Intranet 1 32 can also belong to another service depot/dealer that performs repairs 
and maintenance on other devices that is monitored by the Central Service Center. The 
Central Service Center can communicate service requests to the computer 120D for all 
devices that this service depot/dealer repairs and maintains. The computer 120D will 
communicate with the computer 120F of the Central Service Center through the WAN 
10 to obtain the service history of each of the devices it is responsible for repairing and 
maintaining. The computer 120D will analyze the service requests and the service 
history of those devices and then communicate the service requests to the devices 
through the WAN 10. The users of the devices can then respond appropriately to the 
service requests. 
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[0044] While Figures 2A-2C illustrate a plurality of firewalls, the firewalls are preferable 
but optional equipment and therefore the invention may be operated without the use of 
firewalls, if desired. 

[0045] Figure 3 A illustrates a preferred embodiment of the present invention including a 
Device 20, a Central Service Center 26, a Service Depot/Dealer 30, and the WAN 10. 
The Device 20 includes Static State Data 222, which provides a means to store data that 
does not change over the life of the Device 20, such as the model number, serial number, 
and model characteristics of a device. Device 20 also includes Semi-Static State Data 
220, which provides a means to store data that may change over the life of the Device 20 
but infrequently, such as the ROM version and option configuration of the device. In 
addition, Device 20 includes Dynamic State Data 218, which provides a means to store 
data that changes according to various states of the Device 20, such as the mechanical 
state, the electronic state and the software state. Examples are the paper status in the 
tray, oil, toner, number of prints, sensitivity of the photoreceptor, condition of the paper 
path, location of a copier; battery status of an automobile; and an unexpected error 
condition in the fimware. Further, the Dynamic State Data 218 provides a means to store 
data regarding the events that occur in Device 20 such as when the user interacts with 
the control panel of a copier; with a CD/Radio control of an automobile; and with seat 
adjustment of an automobile. In order to store the state and event information in 
Dynamic State Data 218, Device 20 includes a Monitoring Process 216 to monitor and 
store the state and events of Device 20. Also, the Monitoring Process 216 is able to 
obtain state information from the Static State Data 222, Semi-Static State Data 220, and 
Dynamic State Data 218. The overall system activities of Device 20 are coordinated by 
System Control Process 212. 
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[0046] Further, as shown in Figure 3 A, Device 20 includes a Communication Process 214 
that can be used to communicate the state and event information of Device 20 stored in 
Dynamic State Data 218, Semi-Static State Data 220, and Static State Data 222. 
Communication Process 214 communicates this information to the Central Service 
Center 26 through the Internet 10. The information can be communicated periodically. 

[0047] At power-on time, System Control Process 212 not only brings up the Device 20, 
but also establishes communication with attached devices by first checking the physical 
connections and then establishing communication with the attached devices. Then 
Device 20 remains idle until a user interacts with Device 20. When the user interacts 
with Device 20, the System Control Process 212 interprets the function in which the 
user wants to perform. The System Control Process 212 informs the Tasks/Events 
Processes 2 1 0 to perform the various tasks to complete the function. The Monitoring 
Process 216 logs the interaction of a user along with the state of Device 20. 

[0048] Further in Figure 3 A during the idle time, System Control Process 212 

continuously monitors the state of Device 20 through Monitoring Process 216. The 
System Control Process 212 may send data to Communication Process 214 to 
communicate the event and state information to the Central Service Center 26 through 
the Internet 10 periodically. Or if abnormal states are detected, System Control Process 
212 may send data to Communication Process 214 to communicate the event and state 
information, including the abnormal state information, to the Central Service Center 26 
through the Internet 10. 

[0049] The Central Service Center 26 in Figure 3 A receives state and event information of 
Device 20 from the Internet 10 through Communication Process 224. The Central 
Service Center 26 includes the System Control Process 232 that coordinates the overall 
system activities of the Central Service Center 26. The System Control Process 232 
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stores the state and event information in the Database 228. The Central Service Center 
26 includes an Analysis Process 226 that analyzes the state and event information in 
Database 228 for Device 20 as well as for all other devices that the Central Service 
Center 26 is responsible for monitoring. Also, the Central Service Center 26 includes a 
Historical Process 230 that analyzes the service history in Database 228 for Device 20 as 
well as for all other devices. 

[0050] The Analysis Process 226 informs the System Control Process 232 if the analysis 
of the Database 228 for Device 20 identifies a potential problem or an abnormal 
condition. Then the Historical Process 230 provides service information to the System 
^ Control Process 232 about which Service Depot/Dealer has provided service and 

I r « maintenance to Device 20. System Control Process 232 sends data to Communication 

VI 

/2 Process 224 to communicate the maintenance or repair request of Device 20 to the 

^ Service Depot/Dealer 30 through the Internet 10. 

if [0051] Further in Figure 3 A the Service Depot/Dealer 30 receives the maintenance or 
'--j repair request of Device 20 from the Internet 10 through Communication Process 236. 

:•: 3 

j ff The Service Depot/Dealer 30 includes the System Control Process 238 that coordinates 

];S , the overall system activities of the Service Depot/Dealer 30. The System Control 

Process 238 requests and obtains state, event, and service information of Device 20 from 
Central Service Center 26 through the Internet 10 using the Communication Process 
236. The Service Depot/Dealer 30 includes an Analysis Process 234 that analyzes the 
state, event, and service information of Device 20. The Service Depot/Dealer 30 sends 
data to Communication Process 236 to communicate the maintenance or repair request 
to Device 20 through the Internet 10. It is also possible that personnel of the Service 
Depot/Dealer 30 may contact the owner of the Device 20 to inform the owner of 
necessary maintenance or repair to Device 20. 
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[0052] Although Figure 3a shows that Service Depot/Dealer 30 communicates to Device 
20 through the Internet 10, it is possible that Service Depot/Dealer 30 can communicate 
directly with Device 20 between Communication Process 236 and Communication 
Process 214 (not illustrated). Thus, it is possible that Service Depot/Dealer 30 may be in 
the same location as Device 20. 

[0053] Figure 3B illustrates hardware features of Device 20, Central Service Center 26, 
and Service Depot/Dealer 30 of Figure 3 A utilized to implement the present invention. 
The Device 20, Central Service Center 26, and Service Depot/Dealer 30 all have buses 
270, 280, and 288, which connect the Interface Units 260, 272, and 282 respectively and 
connect the Central Processing Unit (CPU) 262, 276, and 284 respectively. The 
Interface Units allow Device 20, Central Service Center 26, and Service Depot/Dealer 
30 to connect to the Internet 10 so that these components may communicate with one 
another. Also, it is possible that the Interface Unit 260 of Device 20 may be directly 
connected (not illustrated) to the Interface Unit 282 of Service Depot/Dealer 30 without 
the use of the Internet 10. The CPU coordinates the overall system activities of Device 



[0054] Device 20 has a Sensor Unit 258 that senses the mechanical states of Device 20 
that must be stored as dynamic data, such as paper tray, voltage and paper path of a 
copier. Device 20 has Permanent Memory 264 that stores static state data as permanent 
memory, such as ROM. Device 20 has Semi-Permanent Memory 266 that stores semi- 
static state data as changeable memory which does not require power such as EEPROM, 
or which uses low power and can be supported by a battery. Finally, Device 20 has 
Dynamic Memory 268 that stores dynamic state data as changeable memory, which 
does not require power or which uses low power and can be supported by a battery such 



20, Central Service Center 26, and Service Depot/Dealer 30. 



P 



as CMOS RAM. 
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[0055] The Central Service Center 26 has a Disk Unit 274 that holds the database. The 
database will contain state and event information of Device 20 and other devices 
monitored by the Central Service Center 26. 

[0056] Figure 4 illustrates the components of Device 20 that are involved in the process of 
monitoring and communicating its state and event information. The Device 20 contains 
Device Events 150 and Device States 151. Device Events 150 are components of the 
Device 20 that the user may interact with that results in the events. These events are 
monitored. An example of an event is a user's interaction with the control panel of a 
copier. The Device Events 150 generates event information every time the events occur. 
Device States 151 are components of the Device 20 that measure the state of the Device 
20. These states are monitored. An example of a state is the toner level of a copier and a 
radiator temperature of an automobile. The Device States 151 can generate state 
information every time the state of the Device 20 changes or can generate state 
information periodically (e.g., every 5 minutes or 10 minutes), whether or not the state 
of the Device 20 changes. 

[0057] Further in Figure 4, the Device 20 contains a Monitoring System 152. The 

Monitoring System 152 is a dynamic link library (DLL) that the Device Event 150 and 
Device States 151 interfaces with to record the state and event information. The 
Monitoring System 152 monitors and maintains the state and event information of 
Device 20 and when triggered, the Monitoring System 152 will communicate the state 
and event information to a Central Service Center. 

[0058] Further in Figure 4 5 the Device 20 contains an Internet Access Module 154. The 
Internet Access Module 154 interfaces with the Monitoring System 152 so that it may 
communicate the state and event information to the Central Service Center. The Internet 
Access Module 154 provides wire-based or wireless access to the Internet so that 
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communication can occur to the Central Service Center. 

[0059] Figure 5 shows the general event management architecture of the device 20 that can 
be implemented as any one, or a combination of, a dynamic linked library, a script, a 
JAVA or C++ class, a C library routine, etc. The remainder of this discussion describes 
the implementation in terms of a DLL. The device 20 monitors events 150 and its state 
151. The device 20 may obtain its state either periodically (e.g., every minute or every 5 
minutes) or aperiodically (after five minutes, then after ten minutes, then after three 
minutes, etc.). 

[0060] Further in Figure 5, the Monitoring System 152 is the monitoring software or 
monitoring DLL that the device 20 uses to record and maintain the information it 
collects. The Monitoring System 152 provides five interface functions for use with the 
events 150 and one interface for use with the states 151. SetApplicationID allows the 
device to inform the Monitoring System 152 about the identification of the device 20. 
StartMonitoring allows the device 20 to inform the Monitoring System 152 that the 
monitoring system should prepare to log information. StartMonitoring lets the 
Monitoring System 152 initialize itself before recording information. RecordEvent 
allows the device 20 to inform the Monitoring System 152 that it should record the 
information. The device 20 will pass information to the Monitoring System 152 about 
its monitored events and states. The Monitoring System 152 may either maintain 
information about its latest event and/or state or maintain information about its events 
and/or states over a period of time. SelectFormatProtocol allows the device to inform the 
Monitoring System 1 52 which format and protocol to use to communicate the 
information to a desired party. StopMonitoring allows the device 20 to inform the 
Monitoring System 152 that it should stop recording information. In addition to 
triggering the Monitoring System 152 to communicate the information periodically, the 
Monitoring System 1 52 can be triggered to communicate the information to a desired 



Page 20 of 46 



t $ 



party when the device 20 calls the interface function StopMonitoring. 

[0061] Figures 4 and 5 show an Internet Access Module 154 that allows the Monitoring 

System 152 to communicate the state, event and even position information to the desired 
party. The Internet Access Module 154 provides the Monitoring System 152 wireless 
access to the Internet so that it may use simple mail transfer protocol (SMTP) or file 
transfer protocol (FTP) to communicate the information to the desired party such as the 
central service center. The Internet Access Module 1 54 provides the interface function 
ConnectSystem to the Monitoring System 1 52 to provide it access to the Internet. 

[0062] The Monitoring System 152 contains information about the desired party to which 

1-3 the information is communicated. In one embodiment, this information is set up in the 

'.3 

ifl device 20 prior to beginning monitoring. This setup allows the device 20 to 

\f\ communicate the information to any desired party or recipient. Alternatively, the desired 

h± party can be identified after monitoring has begun. 

!L [0063] Figure 6 A shows the general event management architecture of the monitoring 

1.3 

."1 system that can be implemented as any one, or a combination of, a dynamic linked 

W library (DLL), a static linked library, a script, a Java or C++ class, a C library or routine, 

P 

O etc. The remainder of this discussion describes the implementation in terms of a DLL. In 

general, an event/state receiver control application 450 communicates through an 
interface 600. The interface 600 specifies the API for the event management architecture 
(e.g., how information is passed via a C or C++ function call to the object(s) in the 
System manager 602 with the same names). The System Manager computer code device 
602 manages the behavior of other computer code devices by using appropriate objects 
and their functions. Similarly, the Event Logger 604 records all the necessary 
information such as User ID, Application ID, Cumulative Session Number, Start Time, 
Duration and Sequence of Events with the elapsed times when requested through the 
system manager 602. The Event Logger 604 supports functions including: initializeQ, 
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storeEvent(), stopMonitoring(), and getEventData(). 

[0064] The initialize function receives a string parameter for the Application ID. The 

System manager 602 calls this function when startMonitoring is called by the control 
application 450. The function sets the Application ID, takes care of the Cumulative 
number of uses, reads the clock to store the start time in order to compute the elapse 
time and duration, and sets up the user information by examining the registry. 

[0065] After initialization, the storeEvent() function can be called with a string parameter 
for the Event passed by recordEvent. The EventLogger 604 stores the event string and 
the elapsed time from the start time (recorded during the initialize() function call). 

[0066] After the application 450 has completed its usage monitoring, it calls the 

stopMonitoring function so that the duration can be computed. If multiple sessions are 
stored, this function stops the recording of a corresponding session. 

[0067] The EventLogger 604 also provides access to a getEventData function. If the 
stopMonitoring was not previously called (i.e., the current session's duration field is 
undefined), the monitoring is stopped by calling the stopMonitoring function. The 
stopMonitoring function computes the duration of the current session. The getEventData 
function returns an abstract class with the access functions shown in Figure 6B. The 
abstract class facilitates extensions for multiple sessions. 

[0068] The Format And Protocol Information Base System 606 (implemented as any one 
or a combination of package, DLL, static library, etc.) stores the format and protocol 
information and checks the combination of formats and protocols to determine the valid 
combinations. To facilitate the storage process, the storeFormatAndProtocol function 
accepts two parameters (i.e., one for format and one for protocol). The function checks 
to ensure that the parameters are a valid combination. 
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[0069] The component 606 also includes a getFormatAndProtocolVector function returns 
a format and associated vector of protocols. In one embodiment, the function performs 
error checking. For example, if a protocol allows only one format to be sent, then the 
format should be the last format in the function call of selectFormatProtocol. The return 
value is a boolean value where true indicates that valid parameters were returned and 
false indicates that no more data is available. The return parameters are int and vector of 
int. The first int refers to the format while the vector of int refers to the vector of 
protocols for the format. When there is no selectFormatProtocol function call, the 
getFormatAndProtocolVector returns the default setting. Also would be evident, other 
collections (e.g., a list template) may be used in place of a vector. 

[0070] The Data Format Processor 608 is responsible for formatting event data into a 

specified format. One exemplary function is the formatEventData function that receives 
a pointer to the abstract class EventData. The return value is a pointer to the abstract 
class FormattedEventData. Generally, interface to the FormattedEventData abstract 
class is defined as in Figure 6C. 

[0071] The Protocol Processor 61 0 is responsible for communicating the formatted event 
data through the specified protocol. In one embodiment, the processor 610 also encrypts 
the data before it is sent. To output the data, the processFormattedData function is called 
with an input pointer to the abstract class FormattedEventData. The function returns a 
boolean value where "true" represents no errors, and "false" represents the existence of 
an error while sending the formatted data. 

[0072] The System 612 supplies important information and persistent information across 
the execution of the DLL. Some of the important information is timer information 
through the library call. The registry to keep the necessary information is another 
important component of the System 612. Many registry entries are set up at installation 
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time. An exemplary structure for the registry is: 

[0073] HKEY_LOCAL_MACHINE » SOFTWARE -- RicohMonitor XXX 
(ApplicationID) 

[0074] Where XXX represents the Application ID, the following variables are placed in 
the registry under XXX tree: CumulativeUsage, UserlD, SMTP Server, Recipients, 
From, FTP Server, FTP User, FTP Password, FTP Target Path etc. In one embodiment, 
CummulativeUsage is an integer, and the rest of the variables are strings. 

[0075] Figure 7 shows an exemplary calling sequence within the device 20. The device 20 
sets the application ID through the interface function SetApplicationID of the 
Monitoring System. The device 20 starts the monitoring of the state and event 
information through the interface function StartMonitoring of the Monitoring System 
152. The Monitoring System 152 records and maintains start information. The device 20 
obtains state information periodically. For each occurrence, the device calls the interface 
function RecordEvent of the Monitoring System 152 passing the state information so 
that the Monitoring System 152 will keep track of the information. The Monitoring 
System 152 will periodically communicate the information by calling the interface 
function ConnectSystem of the Internet Access Module 154 to obtain access to the 
Internet. This will allow the Monitoring System 152 to communicate the information to 
a desired party. When the device 20 is to be turned off, the device stops monitoring the 
information by calling the interface function StopMonitoring of the Monitoring System 
152. The Monitoring System 152 will communicate the final information by calling the 
interface function ConnectSystem of the Internet Access Module 1 54 to obtain access to 
the Internet and to communicate the information to a desired party. 
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[0076] Figure 8 describes the process of sending the state and event information of the 

device. Steps 1 through 3 show the process of stopping the recording of state and event 
information. Step 4 shows the process of obtaining the information in order to 
communicate it to the Central Service Center. The class CMonitorManager contains 
trigger information about when to communicate the state and event information. Step 5 
shows the process of obtaining the data format and communication protocol in which 
the information is communicated to the Central Service Center. Step 6 creates the data 
formatter for the selected formatting that is used to format the information in step 7. 
Step 8 obtains the protocol processor that is used to communicate the information in 
step 9. Steps 6 and 8 show that the formatters and protocol processors are created only 
when they are needed. 

[0077] Figure 9 describes the use of the remote diagnostic and information collection and 
service system in which the device being monitored is a car. However, the system can be 
used to monitor any motor vehicle such as a motorcycle, recreational vehicle, bus, train, 
motorized boat, or airplane. The system consists of a car, the Internet, the manufacturer 
of the car, and the dealer that sold the car. The car provides state and event information 
to the Monitoring System of the car. The Monitoring System records and maintains the 
interaction between the car and the owner. The events that the Monitoring System may 
record are pressing on the gas pedal, turning on the air condition, and shifting the gear 
into drive. The Monitoring System also records and maintains the state of the car. The 
states that the Monitoring System may record are fuel level, mileage of the car, and 
radiator temperature. 

[0078] When the car turns off or periodically, the Monitoring System will communicate 
the event and state information to the manufacturer of the car. The manufacture of the 
car can be considered the Central Service Center of this system. The Monitoring System 
will obtain wireless access to the Internet to communicate the information. The 
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information is communicated to the manufacturer of the car through the Internet. The 
state and event information will be delivered to the workstation of the manufacturer. The 
information will be placed in the disk where historical information about the states and 
events of the car is stored. 

[0079] The manufacturer will analyze the data it receives about the car. If the manufacturer 
discovers potential problems with the car, then the manufacturer will communicate the 
problem to the dealer who sold the car through the Internet. The car dealer is considered 
the Service Depot/Dealer of the system. The information about the problem with the car 
is delivered to the workstation of the dealer. The dealer can query information about the 
car from the workstation of the manufacturer through the Internet to obtain its service 
history. The dealer will then contact the owner of the car to correct the problem with the 
car. 

[0080] The aforesaid methods and steps for remote monitoring are contained according to 
this invention on a computer program product. The computer program product is a 
storage medium including instructions which can be used to program or control a 
computer or a plurality of networked computers to perform a process of the invention. 
The storage medium can include, but is not limited to, any type of disk including floppy 
disks, optical discs, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, 
EEPROMs, magnetic or optical cards, or any type of media suitable for storing 
electronic instructions. 

The various computers utilizeckby the present invention, including the computers 
42 and 56A-56D of Figures 2A-2C, may be implemented as illustrated in Figure 10. 
Further, any other computer utilized bAthis invention may be implemented in a similar 
manner to the computer illustrated in Figkre 10, if desired. However, not every element 
illustrated in Figure 10 is required in each of those computers. In Figure 10, the 
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computer 1002 includes a CPU 1004 which may be implemented as any type of 
processor including commercially available microprocessors from companies such as 
, Intel, AMD, Motorola, Hitachi and NEC. There is a working memory such as a RAM 
/ 1006, and a wireless interface 1008 which communicates with a wireless device 1010. 
The communication beWeen the interface 1008 and device 1010 may use any wireless 
medium (e.g., radio waves or light waves). The radio waves may be implemented using 
a spread spectrum technique such as Code Division Multiple Access (CD A) 
communication or using a frequency hopping technique such as that disclosed in the 
Bluetooth specification. \ 

[0082] There is a ROM 1012 and a flash memory 1014, although any other type of non- 
volatile memory (e.g., EPROM, or an EEPROM) may be utilized in addition to or in 
place of the flash memory 1014. An input controller 1016 has connected thereto a 
keyboard 1018 and a mouse 1020. There are serial and parallel interfaces (not shown) 
connected to serial and parallel devices (not shown). There is an IEEE 1394 device, 
commonly referred to as a fire wall device 1032, connected to an IEEE 1394 interface 
(not shown). The various elements of the computer 1002 are connected by a system bus 
1038. A disk controller 1040 is connected to a floppy disk drive 1042 and a hard disk 
drive 1044. A communication controller 1046 allows the computer 1002 to 
communicate with other computers (e.g., by sending e-mail messages) over a telephone 
line 1048 or a network 1049. An I/O (Input/Output) controller 1050 is connected to a 
printer 1052 and a hard disk 1054, for example using a SCSI (Small Computer System 
Interface) bus. There is also a display controller 1056 connected to a CRT (Cathode Ray 
Tube) 1058, although any other type of display may be used including a liquid crystal 
display 1068, a light emitting diode display, a plasma display, etc. 
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